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(57) ABSTRACT 

The priority of the flow of packets representing calls or other 
connection requests within a packet network (10) is deter- 
mined from the Class-of-Servicc of the call. Upon receipt of 
a call, a recipient router (12 122, 123) identifies available 
paths, typically by exchanging messages with the other 
routers in the network. After selecting the path, the recipient 
router or centralized bandwidth broker determines whether 
the links comprising the selected path have available band- 
width for the class of service of the call. If so, the router 
routes the call to the next hop along the path. Otherwise, the 
router selects another path(s) and checks whether the links 
on the path possess sufficient bandwidth for the class of 
service of the call. 

7 Claims, 1 Drawing Sheet 
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INTERNET PROTOCOL (IP) CLASS-OF- service of the call or other connection request is determined. 

SERVICE ROUTING TECHNIQUE Then a path is selected that has a minimum cost, such as for 

example a minimum number of hops. Thereafter, a check is 

made by the originating router or possibly a centralized 

TECHNICAL FIELD 5 bandwidth broker, based on flooded network status 

, ...... ^ „ , information, of the selected path as to whether the links from 

This invenUon relates to technique for rouUng calls and ^^^^^ ^^^^j^, t,,^^ ,^^1^^,^ d I, 

other types of connection requests in an IP network. bandwidth capacity not reserved for other services) for the 

T> A i^T^i-n r^T ^KTT^ A determined class of service. If the links possess the requisite 

BACKGROUND ART l j j.u * * .i. i . 7 ■ 

10 bandwidth, the router routes the packet over the outgoing 

Traditional telecommunications networks typically use link. Otherwise, another path is selected and the step of 

dedicated circuits to carry telephone traffic between facili- determining if the links forming the path have the requisite 

tics. Within such traditional networks, switching systems, depth is repeated. After an allowed path is found, the IP 

such as the 4ESS switching systems used by AT&T, route packets are treated according to their class-of-service des- 

calls by setting up a circuit that lasts the entire duration of 15 ignated priority in the queuing discipline used by the routers 

the call and then tearing down the circuit thereafter. For this in the path. 

reason, such traditional networks are commonly referred to ^„ r™,„ 

as "circuit-switched" networks. BRIEF SUMMARY OF THE DRAWING 

Increases in traffic and capacity constraints on existing FIG. 1 depicts a block schematic diagram for practicing 
switches within such circuit-switched networks has '^^ the IP Class-of Service routing technique of the invention, 
prompted the development of packet-based networks, and in 

particular, Internet-Protocol (IP) networks. A typical IP DETAILED DESCRIPTION 

network employs a plurality of routers, such as those manu- piG. 1 shows a simplified block schematic diagram of an 

factured by Cisco, Ascend Communications, Bay Networks jp network 10 comprised of a plurality of routers, cxcmpli- 

and Newbridge, among others, to route data packets repre- fled by routers IZj, 12^ and 12^. Links 14^ 14^, and I43 

senting a call or other conneaion independenUy from an connect router pairs 12^-122, and 12^-123, respcc- 

origin to a destination based on a destination address in each tively allowing the routers to pass data packets, representing 

packet. Present day IP networks of the type described above telephone calls, or other information among themselves, 

are characterized by best effort routing. In other words, Although the illustrated embodiment of network 10 includes 

routing, and particularly, path selection occurs generally only the three routers 12,-123 and three pairs of connecting 

without regard to criterion such as class of service. Today, links, the network may include a far larger number of routers 

examples of the most prevalent routing techniques in IP and interconnecting links. 

networks are the Open Shortest Path Fii^t (OSP^ protocol y^^^ ^^^^ ^^^^^^ ^^^^^^ ^^^^^^ ^^^^^^^ 10 

and Border Gateway Protocol (BGP). In the OSPF protocol, ^^^^^^ ^^^^ ^^^^^^^ j^^^ preferably, 

for exaniple, routers withm the network exchange mfonna- ^ ^^^^^ ^^^^^^jp t^ways, exemplified by voice/IP 

Uon with each other by a floodmg technique so that each ^ ^5 ^5 ^5 illustrated embodiment, 

maintains a database of the network topology Using the ^^.^^/jp ^5 ^^^^^^^ Narrowband Integrated 

information m its stored database, each router se ects a path g^^^^^^ digital Network (NISDN) traffic, e.g., traffic trans- 

for each packet m accordance with user-established cost miuedin64kilobitper second blocks. Tlie voice/IP gateway 

metrics that typically reqmre the short^t possible path. 15, handles Broadband Integrated Services Digital Network 

Usmg such cost mctncs each router establishes its routing ^^^^^^ ^^^^^ ^^^^^ ^^^^ ^^^^^^^ ^44 ^^^^^^ 

table accordingly so each router can select a path havmg, for ^^^^^^^ ^^^^ transmission rate for NISDN traffic. Such 

example, a mmimum number of links. gj^^^ ^^^^^ -^^^^^^ ^^.^^^ ^-^^^ -^^^ ^^^^^ 

TraditionaUy, providers of telecommunications services example. The voice/IP gateway handles data already in 

have offered different grades or classes of service based on an IP format. Depending on the nature of the traflGc, the 

customer demand. To meet quality objectives for such network 10 may include other Voice/IP gateways (not 

different grades of service, telecommunications providers, shown) each designed for a particular format, 

such as AT&T, have employed Class-of-Service routing TraditionaUy, the routers 12,, 12^, and U3 have utilized 

techniques in traditional circuit switched networks, U.S. Pat. ^ ^^^^ ^^^^^ ^^^^^^g p^^^y ^^ute traffic within the network 

No. 5,392,344, issued m the name of Gerald R. Ash ct al., ^^^^ ^^^^ algorithms as the Open Shortest Path First 

on Feb. 21, 1995, and assigned to AT&T. (incorporated by (Q^pp) algorithm that seeks to route each packet on the 

reference herem) descnbcs and claims such a Class-of- shortest possible path. Presently, the OSPF routing protocol 

Service routing technique. Unfortunately, Class-of-Service ^^^uld theoretically support different Types of Service (TOS) 

routing docs not exist with present day IP tclccommumca- ^ased on the following criteria: Delay, Throughput and 

tions networks. Thus, there is a need for an Internet Protocol Reliability. However, IP networks, such as network 10, 

(IP) Qass-Of-Service rouUng technique. ^^^^ ^^^^^e OSPF routing have not offered Class of Service 

RRIFF SUMMARY OF TRF TNVFNTTON ^^^^^^ available in circuit-switched networks, 

BRIEF SUMMARY OF THE INVENTION ^^^^^ ^^^^^^^ telecommunications carriers to offer 

Briefly, the present invention provides a technique for 60 different classes of service using an IP network, 

routing a call or other connection request between an origin The present invention affords a technique for accomplish- 

and destination in an IP network comprised of routers ing COS routing in an IP network. Upon determination of 

connected by links that carry data packets between routers. the class of service, which includes the priority and other 

In accordance with the invention, the routers exchange parameters of the call or other connection at its initial set-up, 
status messages to identify available paths between the 65 an originating router that receives packets from one of the 

origin and destination. Each path includes at least one gateways 15^, ISj and ISg selects a route based on the 

outgoing link from one router to another. First the class of requisite deptii (required bandwidth), which in turn is based 
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on the flow priority and load state of the links (14i, 142, l^s) 
in network 10. Once the originating router selects an admis- 
sible path, each subsequent router performs routing of the 
packets according to the determined path and priority, as 
now described further. 

To determine requisite depth, the originating router in 
network 10 determines the equivalent bandwidth needed for 
the call or other connection and also utilizes a Bandwidth in 
Progress (BWIP) indication for the determined class of 
service at the start of the call or other connection. To that 
end, two quantities: Bandwidth Peg Count (BWPC) and a 
Bandwidth Overflow Count (BWOV) are kept for each link 
connecting an originating/terminating router pair. During a 
given interval of X minutes, each router, such as router 12^ 
tracks for each link to another router the following quanti- 
ties: 

BWPC(link)=Sum of aU Bandwidth (BW) required for 

flows on the link; and 
BWO V(link)-Sum of BW required for each blocked flow 

on the link 

In the class of service routing method, various virtual 
networks are maintained which are allocated bandwidth 
according to demands. Each router also maintains the fol- 
lowing two Depth parameters for each virtual network: 
BWavg^;^ the Bandwidth required for each Virtual Net- 
worky (VNJ and node-pair k to carry the average 
Bandwidth-In-Progress (BWIP^j^ [=Erlang Load^ 
(Avg bandwidth per virtual connection)^J and 
BWmax^jt* Bandwidth required to meet the blocking 
probability Grade -of-Service obj6ctive=[TREBS 
(Erlang Load^;^ Grade-of-Service)x(Avg bandwidth 
per virtual cormectionXJ 
where TREES represents the well known Erlang-B for- 
mula for trunk requirements. 
In practice , BWavg^ and BWmax^,^ are computed at 
prescribed intervals, typically weekly. Different values of 
BWavg^jt and BWmax^;^ may be used for different periods of 
the day (business peak, residence peak). 

Four different blocking reservation thresholds (BRl, 
BR2, BR3, BR4) are used, where 
0%gBRl^BR2^BR3^BR4^100%. The reservation level 
N is 0 if the Unk blocking (NN) does not exceed BRl, N-1 
if NN exceeds BRl but not BR2, N=2 if NN exceeds BR2 
but not BR3, N=3 if NN exceeds BR3 but not BR4, and N«4 
if NN exceeds BR4. This relationship is depicted in Table I. 

TABLE I 



N 


Determination of Reservation Level (N) 


Condition 


0 


NN (link blocking) ^ BRl 


1 


BRl < NN ^ BR2 


2 


BR2 < NN g BR3 


3 


BR3 < NN ^ BR4 


4 


BR4 < NN 



10 



The Idle Link bandwidth (ILBW) for each link is used in 
the determination of the link Load State. In addition to the 
Load State of each local link (i.e., the link associated with 
a particular router), the Load State of all other network links 
is received from other routers using, for example, an exten- 
sion of the currently used OSPF flooding mechanism. A 
metric such as "throughput or bandwidth available" might 
theoretically be supported by the OSPF routing algorithm to 
provide an indication of the Load State of all links in the 
network 10. Also, another metric such as "delay" may 
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provide an indication of the Load State. In addition to being 
flooded to every other router in the network, this link metric 
information on bandwidth available, delay, or other mea- 
sures could be flooded to a centralized bandwidth broker 
(BB), 20 which could track the link status information and 
perform routing computations, as discussed further below. 

A link extending between a router pair is considered in a 
reserved (R) state if the Idle Bandwidth 0LBW) is less than 
or equal to a Reserved Threshold (Rthr), as defined below. 
The link is considered in the Heavily Loaded (HL) state if 
the Idle Bandwidth is less than or equal to a Heavily Loaded 
threshold (HLthr) for the link but more than Rthr. 
Conversely, the link is considered Lightly Loaded (LL) if the 
Idle Bandwidth for each link in the path is greater than 
HLthr for the link. This relationship is best depicted in Table 
II (hereafter we have omitted, for simplicity, the subscripts 
k denoting the node-pair for each variable): 

TABLE n 
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Load State Condition 


Name of State 


Condition 


Busy B 


ILBW - 0 


Reserved R 


ILBW ^ Rthr 


Heavily Loaded HL 


Rthr < ILBW S HLthr 


Lightly Loaded LL 


HLthr < ILBW 



40 



45 



The Reservation Threshold Rthr and Heavily Loaded 
Threshold HLthr are given by the relationships 

Rthr=Nx.0.05xBWmax, 

HUhr-Rthr+.0.05xBWmax^ 
where N is the reservation level based on the Blocking 
Reservation thresholds (BRl, BR2, BR3, and BR4). 

The Depth-of-Search (DoS) for a flow to use various Load 
States depends on the Bandwidth-In-Progress (BWIP^), the 
BWavg^ and BWmax^ thresholds, the priority of the call or 
other connection, and whether the path is the first choice 
path or alternate path, as illustrated in Table III (here again 
we have omitted, for simplicity, the subscripts k denoting the 
node-pair for each variable): 



TABLE III 



DoS CRITERION 



Norma] Service 



First 



Load State 




Choice 


Alternate 


Best Effort 


Allowed^ 


Key Service 


Path 


Path 


Service 


R 


if BWIP^^ 2 X 


if BWIPv 


Not 


Not Allowed 




BWmax^ 




Allowed 








BWavg^ 






HL 


if BWIP^^ 2 X 


if BWIP^ 


if BWIP^ 


Not Allowed 




BWmax^ 












BWmaXv 


BWavg, 




LL 


All BWIPv 


All BWIPv 


All BWIP^ 


All BWIP^ 



The originating router determines the allowed DoS for the 
call or other connection according to Table III. The origi- 
nating router first attempts to route the call on shortest path 
to the terminating router. 
For a key service flow: 

If BWIP^^2xBWmax^, then all load states are 
allowed. 

If BWIP^>2xBWmax^, then only LL links are allowed. 
For a normal service flow: 
If BWIP^BWavg^,, then all load states are allowed on 

the first choice path and the HL and LL states are 

allowed on alternate paths 
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If BWavg^<BWIP^^BWmax^, then only HL and LL 
states are allowed on the first choice path and LL 
state is allowed on alternate paths 
If BWIP^>BWmax^, then only the LL links are allowed 
are on first choice and alternate paths 

For a best effort service call only LL Unks are allowed. 

The originating router first determines the class of service 
of the call (or other connection request) from information 
associated with the call. In routing caUs in accordance with 
the invention, an originating router, (e.g., router 12^) will 
determine the. Load State of the network Unks. As discussed 
previously, the Load State information for all links in the 
network 10 could be distributed, for example, via the OSPF 
flooding protocol. The originating router selects a path 
having, for example, a minimum number of hops using the 
shortest path routing algorithm. Using the depth parameters 
discussed above, the originating router then checks whether 
the links forming the selected path have an available depth 
(bandwidth capacity) for the determined class of service. If 
so, the router routes the packets of the call or connection 
request over the links in the selected path. Otherwise, 
another path is selected and the step of determining if the 
Unks in the path have available capacity and depth is 
repeated. If the originating router cannot route the call or 
other connection to the selected destination router, and there 
are other terminating routers that can route the call, then the 
originating router uses the shortest path algorithm to select 
candidate paths and the class of service routing technique to 
route the call to such a terminating router. If there is no 
available terminating router, the call is blocked. 

As was discussed earUer, the centralized bandwidth bro- 
ker (BB) 20 could receive the Unk status metric information 
through the flooding mechanism, and perform the same 
routing computations described above for the originating 
router. That is, in response to a request from an originating 
router, for example, the BB 20 could select a path having a 
minimum number of hops using the shortest path rouUng 
algorithm, depth parameters, and available Unk bandwidth. 
Once an admissible path is found, the path information is 
returned to the originating router which can then route the 
packets in the flow accordingly. 

After the path is established by the originating router and 
packets are flowed on the path, at each hop the recipient 
router performs priority packet queuing based on the routing 
priority assigned by the originating router to each packet, 
such as contained in the TOS field indicator of the packet. 
The TOS indicators in each packet are set so that the 
recipient router at each subsequent hop uses the same 
queuing priority as determined by the originating router for 
the selected shortest path and COS routing treatment. Hence 
the COS capability afforded by the method of the invention 
may be enhanced by adding a priority queuing capability. At 
each Unk, the router maintains a queuing discipUne such that 
packets having a higher TOS requirement (TOS and prece- 
dence bits) have priority over lower TOS requirements, such 
as best effort service. 

The foregoing describes a technique for achieving Class- 
of-Service routing in an IP network. 

The above-described embodiments merely illustrate the 
principles of the invention. Those skilled in the art may 
make various modifications and changes that will embody 
the principles of the invention and fall within the spirit and 
scope thereof. 

What is claimed is: 

1. A method for routing a connection between an origin 
and destination in an Internet Protocol (IP) network com- 
prised of a plurality of routers connected by links that carry 
packets between the routers, comprising the steps of: 
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(a) exchanging status messages within the network to 
identify a group of available paths each running 
between the origin and destination, each path including 
at least one link; 

(b) selecting among the group of available paUis a first 
path for routing the connection; 

(c) determining a class of service for the connection; 

(d) checking the selected path to determine whether each 
Unk forming the selected path has an available band- 
width for the class of service of the connection, and if 
so, routing the data packets representative of the call 
over said outgoing link; otherwise; 

(e) selecting another path; and 

(f) repeating step (d) and repeating step (e) in the event 
said another path has a link lacking available 
bandwidth, 

wherein the step of checking whether the link has an 
available bandwidth includes the steps of: 

measuring actual bandwidth on said link: 

determining link blocking in accordance with the actual 
bandwidth; 

establishing reservation thresholds in accordance with the 
Unk blocking; 

determining the load state of the links in a path in 
accordance with the bandwidth reservation thresholds; 
and 

establishing the availability of the path in accordance with 
the class of service of the connection request, the load 
state of the links in the path, and a required bandwidth 
for each virtual network associated with the class of 
service for the connection. 

2, The method according to claim 1, wherein the required 
bandwidth for the class of service is established periodically. 

3. A method for routing a connection between an origin 
and destination in an Internet Protocol (IP) network com- 
prised of a pluraUty of routers connected by links that carry 
packets between the routers, comprising the steps of: 

(a) exchanging status messages within the network to 
identify a group of available paths each running 
between the origin and destination, each path including 
at least one Unk, wherein each link may have one of 
reserved, lightly loaded, or heavily loaded load states; 

(b) selecting among the group of available paths a first 
path for routing the connection; 

(c) determining a class of service for the connection, 
wherein the classes of service include key service, 
normal service and best effort service; 

(d) checking the selected path to determine whether each 
link forming the selected path has an available band- 
width for the class of service of the connection, and if 
so, routing the data packets representative of the call 
over said outgoing link; otherwise; 

(e) selecting another path; and 

(f) repeating step (d) and repeating step (e) in the event 
said another path has a link lacking available 
bandwidth, 

wherein for key service, all load states are allowed if 
actual bandwidth in progress (BWIPJi2xBwmax^, 
where 

BWavg^;t, the Bandwidth required for each Virtual 
Network^ (VN J and node-pair k to carry the average 
Bandwidth-In-Progress (BWIP J [»Erland Load,p< 
(Avg bandwidth per virtual connection)^J and 

BWmax^jt* ihe Bandwidth required to meet a blocking 
probability Grade-of-Service objective-[TREBS 
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(Eriang Load^^t, Grade -of-Service)x(Avg bandwidth 
per virtual connectionXJ. 

4. The method according to claim 3, wherein for key 
service, only lightly loaded links arc allowed if BWIP^2x 
BWmax^. 5 

5. A method for routing a connection between an origin 
and destination in an Internet Protocol 0P) network com- 
prised of a plurality of routers connected by links that carry 
packets between the routers, comprising the steps of: 

(a) exchanging status messages within the network to 
identity a group of available paths each running 
between the origin and destination, each path including 
at least one link; 

(b) selecting among the group of available paths a first 
path for routing the connection; 

(c) determining a class of service for the connection, 
wherein the classes of service include key service, 
normal service and best effort service; 

(d) checking the selected path to determine whether each 20 
link forming the selected path has an available band- 
width for the class of service of the connection, and if 
so, routing the data packets representative of the call 
over said outgoing link; otherwise; 

(e) selecting another path; and 
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(f) repeating step (d) and repeating step (e) in the event 
said another path has a link lacking available 
bandwidth, 

wherein for normal service, all load states are allowed on 
the first choice path and heavily loaded and lightly 
loaded states are allowed on alternate paths, if actual 
bandwidth in progress (BWIPJiBWavg^, where 
BWavg^jt, the Bandwidth required for each Virtual 
Network^ (VN J and node-pair k to carry the average 
Bandwidth-In-Progress (BWIP J [=Erland Load,;tX 
(Avg bandwidth per virtual connection)^^ and 
BWmax^jt^ the Bandwidth required to meet a blocking 
probability Grade-of-Service objective-i[TREBS 
(Eriang Load^^^, Grade-of-Service)x(Avg bandwidth 
per virtual connection)^J. 

6. The method according to claim 5, wherein for normal 
service calls, heavily loaded and lightly loaded states are 
allowed on the first choice path and only the lightly loaded 
load state is allowed on alternate paths, if 
BWavg,jt<BWIP,^ BWmax,^. 

7. The method according to claim 5, wherein for normal 
service calls, only lightly loaded links are allowed on all 
paths when BWIP^>BWmax^ 

***** 
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